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1.  Introduction:  Model  reference  adaptive  schemes  for  the  identification  and 
control  of  continuous  and  discrete  systems  have  been  discussed  by  numerous 
authors  in  recent  years  [1-9].  Among  the  many  approaches  that  are  currently 
in  vogue,  the  stability  approach  using  Lyapunov  Theory  and  the  Hyperstability 
Theory  of  Popov  have  found  wide  acceptance.  The  problem  of  convergence  of  the 
parameters  of  a dynamical  system  to  desired  values  in  identification  and  control 
problems  is  recast,  using  this  approach,  to  the  equivalent  asymptotic  stability 
problem  of  a set  of  error  differential  or  difference  equations. 

In  a recent  paper  [9]  three  such  error  models  were  described  for  continuous 
systems  which  arise  frequently  in  problems  of  adaptation.  Discrete  versions  of 
these  models  are  also  very  desirable  since  in  most  applications  which  use  a 
computer  as  a part  of  the  controller,  discrete  rather  than  continuous  algorithms 
are  used.  While  the  discrete  versions  of  the  first  two  models  can  be  obtained 
in  a relatively  straightforward  manner  from  their  continuous  counterparts,  the 
third  error  model  has  proved  to  be  considerably  more  difficult.  In  this  paper, 
a simple  structure  is  chosen  for  the  third  error  model  and  a complete  stability 
analysis  is  presented.  The  applications  of  the  new  model  to  adaptive  identifica- 
tion and  control  are  also  briefly  discussed. 

In  a forthcoming  report  [12]  different  versions  of  three  discrete  error 
models  and  their  applications  to  adaptive  observers  and  controllers  will  be 
treated  extensively  and  the  reader  is  referred  to  that  report  for  further  details 
Only  the  principal  result  concerned  with  the  third  error  model  is  presented  in 
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this  paper.  Its  detailed  analysis  here  is  justified  by  its  simplicity  and 
frequent  use  in  real  applications. 

2.  The  Error  Model  for  the  Continuous  Case:  For  the  sake  of  completeness  as 
well  as  to  provide  the  reader  with  a basis  for  comparison  with  the  discrete  case, 
the  error  model  of  the  third  prototype  [9]  for  the  continuous  case  is  briefly 
discussed  in  this  section.  Figure  (1)  represents  the  error  model  in  block 
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(1) 


Figure  (1) 

diagram  form.  The  model  is  described  by  the  equations 

e(t)  = Ae(t)  + b<f>T(t)u(t) 

T 

e^t)  = c e(t) 

where  e(t)  is  an  (nxl)  state  vector,  <(>(t)  and  u(t)  are  m dimensional  vectors 

with  the  elements  of  u(t)  piecewise  continuous  and  uniformly  bounded.  A is  a 

stable  (nxn)  matrix,  b and  c are  (nxl)  constant  vectors,  with  (A,b)  completely 

T -1 

controllable,  and  the  transfer  function  c (sI-A)  b is  strictly  positive  real. 
The  elements  of  the  vector  4>(t)  are  unknown  but  the  time  derivative  $(t)  can 
be  adjusted  using  the  signals  u(t)  and  e^(t)  which  can  be  measured.  The  aim  of 
the  adjustment  is  to  make  11m  e..(t)  = 0. 

t-K»  1 

If  the  adaptive  law 


<p(t)  = -r  u(t)e1(t) 


r > o 


(2) 


is  chosen,  it  can  be  shown  easily  using  the  Kalman-Yacubovlch  Lemma  that 
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(1)  e(t)  and  4>(t)  are  bounded 
(ii)  11m  e(t)  * 0 

and  (111)  If  u(t)  Is  sufficiently  rich  [10] 

11m  <f>(t)  * 0 

t-K» 

T T -1 

Proof : Choosing  V (e , <J> ) = e Pe  + 4>  T t > 0 as  a candidate  for  a Lyapunov  function 

V(e,<j,)  =*  eT[ATP  + PA]e  + 2eTPb<()Tu  + 2<j,Tr"]> 

T 

By  the  Kalman-Yacubovich  Lemma  a matrix  P = P >0  exists  such  that 

T T 

A P + PA  = -qq  - eL 

Pb  = c 

T T -1 

for  some  vector  q,  matrix  L = L > 0 and  e > 0 iff  c (sI-A)  b is  strictly  posi- 
tive real.  In  such  a case, 

V(e,<J>)  = -eT(qqT+eL)e  + 2 e^ifJu  + 2 <f>Tr  1J> 

By  choosing  the  adaptive  law  (2)  v becomes 

V(e,$)  - -eT(qqT+eL)e  $ 0 

so  that  the  system  is  stable  and  (1)  holds.  If  u(t)  is  uniformly  bounded  it 

follows  [8]  that  lim  e(t)  * 0.  The  convergence  of  if>(t)  has  been  extensively 
t 

investigated  [10]  and  it  has  been  shown  that  when  the  input  u(t)  is  "sufficiently 

rich"  lim  $(t)  ” 0. 
t-*-«> 

3.  The  New  Error  Model  for  the  Discrete  Case:  Figure  (2)  represents  the  error 
model  of  the  third  prototype  for  the  discrete  case  and  is 

e(k+l)  * Ae(k)  + bv(k) 
e^(k)  - cTe(k)  + dv(k) 

v(k)  - $T(k)u(k)  - ouT(k)Tu(k)e1(k) ; a > r - rT  > 0 


(3) 
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f; 


where  e(k)  and  u(k)  are  respectively  n and  m dimensional  vectors  and  v(k) , e^(k) 
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scalars.  A Is  a matrix,  b and  c are  vectors  of  suitable  dimensions  and  d is  a 

T -1 

positive  scalar  such  that  the  z-transfer  function  d + c (zI-A)  b is  strictly 
positive  real  [12]. 

From  Figure  (2)  it  is  seen  that  the  model  contains  a known  linear  time- 

invariant  part  with  a strictly  positive  real  transfer  function,  a known  time 
T 

varying  gain  ou  (k)Tu(k),  which  depends  on  the  input  signal,  in  the  feedback 
path  and  a time  varying  vector  gain  $(k)  in  the  feedforward  path.  The  vector  <t>(k) 
is  assumed  to  be  unknown  but  changes  in  <t>(k)  can  be  made  using  the  measured  sig- 
nals u(k)  and  e^(k).  The  objective  is  to  determine  suitable  adaptive  control 
laws  for  updating  <Kk)  such  that  in  the  limit  e^(k)  + 0 as  k + 0.  From  the 
previous  section  it  is  seen  that  this  adaptive  updating  is  quite  simple  in  the 
continuous  case.  While  relatively  complex  schemes  are  known  in  the  literature 
[5],  our  aim  is  to  develop  a scheme  for  the  discrete  case  which  is  comparable 
in  its  simplicity  to  that  in  the  continuous  model.  The  principal  result  of  this 
paper  is  that  the  adaptive  law 

A$(k)  - $(kfl)  - 4>(k)  * -r  e^(k)u(k)  (4) 


II 


achieves  the  desired  aim.  While  this  adaptive  law  is  similar  to  (2)  in  the  con- 
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tlnuous  case,  it  Is  achieved  by  using  an  additional  feedback  signal  in  the  discrete 
model. 

Lemma;  Given  an  (nxn)  matrix  A with  all  its  eigenvalues  within  the  unit  circle, 

a symmetric  positive  definite  matrix  r,  vectors  b,c  e Rn  with  (A,b)  completely 

controllable  and  u(k)  : Z+  -*■  Rm  whose  elements  are  bounded,  the  equilibrium  states 

of  the  set  of  n + m difference  equations  (3), (4)  is  stable  and  lim  e(k)  * 0 if 

T -1 

the  transfer  function  d + c (zI-A)  b is  strictly  positive  real.  Further  if  u(k) 
is  sufficiently  rich,  11m  4> (k)  = 0. 

k-w 

Proof : From  the  discrete  version  of  the  Kalman-Yacubovich  Lemma  [11]  it  is  known 

T -1  T 

that  if  d + c (zI-A)  b is  strictly  positive  real,  a matrix  P = P >0  exists  such 

that 

T T 

A PA  - P » -qq  - eL 

ATPb  = c/2  + vq  (5) 

T 2 

d - b Pb  = v 

T 

for  some  vector  q,  matrix  L ■ L >0  and  e,  v > 0. 

Defining  a Lyapunov  function  candidate  for  the  set  of  difference  equations 
(3), (4)  as; 

V(e(k)  , 4> ( k) ) - 2eT(k)Pe(k)  + 4>T(k) r"Vk) 

we  obtain 

AV(e(k),<Kk))  - AV(k)  = V(kfl)  - V(k) 

- 2[eT(k)(ATPA-P)e(k)  + 2eT(k)ATPbv(k) 

+ bTPbv2(k)]  + ^T(kH-l)r'%(kH-l)  - d>T(k)r_1<|>(k) 

Choosing  the  matrix  P given  by  the  relations  (5); 

AV(k)  - -2[eT(k)q-vv(k)]2  - 2eeT(k)Le(k)  + 2ei(k)v(k) 

+ 2^T(k)r“S(k)  + A$T(k)r_1A$(k) 


I I ■ M A. 


With  the  adaptive  law  (4)  for  A<j>(k)  the  sum  of  the  last  three  terms  may  be  ex- 


pressed as 

2e1(k)v(k)  - 2^T(k)e1(k)u(k)  + e2(k)uT(k)ru(k) 
or  (-2o+l)u^(k)ru(k)e^(k) 

Hence  AV(k)  * -2[eT(k)q-vv(k)  ]2  - 2eeT(k)Le(k)  + (-2ot+l)uT(k)ru(k)e2(k) 

i 0 If  a > j (6) 

The  system  (3),  (4)  is  stable  and  e(k)  and  4>(k)  are  bounded  if  e(0)  and  4>  (0)  are 
bounded. 

Having  established  the  global  stability  of  the  discrete  error  model  we  now 
state  some  of  its  other  stability  properties: 

(I)  The  boundedness  of  e(k)  and  $(k)  are  assured  even  when  u(k)  is  not  bounded. 

(II)  Furthermore,  we  can  prove  11m  e(k)  0,  lim  e (k)  ■*  0 whether  or  not  u(k) 

k-*»  k*”  i 

is  bounded.  Defining 

(2a-l)uT(k)ru(k)  - 5(k)  , C(k>  > 0 

we  have 

AV (k)  = -2[eT(k)q-vv(k) ]2  - 2eeT(k)Le(k)  - £(k)e2(k) 

00 

| I AV (k) | = |V(»)  - V(0)|  < » since  AV(k)  < 0 
k-0 

I {2[eT(k)q-vv(k) ]2  + 2eeT(k)Le(k)  + £(k)e2(k)}  < ® 
k-0  1 

Hence  we  conclude  lim  e(k)  - 0 for  u(k)  bounded  or  not. 
k-w» 

If  u(k)  is  unbounded,  so  is  C(k),  e^(k)  has  to  go  to  zero. 

If  u(k)  is  bounded  but  does  not  tend  to  zero  as  k + ■»,  £(k)  does  not  tend 
to  zero  and  hence  e^(k)  -+•  0.  If  however  u(k)  does  tend  to  zero  as  k -*•  00 
then  e^(k)  •>  0 by  (3)  and  the  result  follows. 

Since  from  (11)  £(k)e2(k)  -*■  0,  4>(lcfl)  - 4>(k)  in  (4)  tends  to  zero  or 

* 

$(k)  -*■  <p  , a constant  vector.  From  (3)  it  follows  that  if  u(k)  is 


(iii) 
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T 

ft 

"sufficiently  rich"  4>  ■ 0 or  <fr(k)  ■>  0 asymptotically. 

(iv)  In  Figure  (2),  if  we  Just  consider  the  loop  with  the  strictly  positive 

T 

real  transfer  function  in  the  forward  path  and  (au  (k) Tu(k) Je^Ck)  in 
the  feedback  path,  it  follows  that  this  loop  is  uniformly  asymptotically 
stable  if  u(k)  is  bounded.  Therefore,  if  there  is  any  input  disturbance 
which  tends  to  zero,  the  effect  of  this  disturbance  on  the  output  will 
also  tend  to  zero. 

A Note:  As  pointed  out  in  the  Introduction,  a simple  adaptive  law  is  achieved 

by  the  use  of  the  structure  of  the  error  model  shown  in  Figure  (2)  which  involves 

T 

the  use  of  the  feedback  term  (au  (k)Tu(k))e^(k) . In  general,  the  output  of  the 

T 

unknown  gain  (i.e.  $ (k)u(k))  must  be  assumed  to  be  inaccessible  for  measurement 
since  otherwise  we  would  use  the  first  prototype  error  model  as  discussed  in  [4]. 
Hence  one  may  question  the  very  validity  of  the  model  described  so  far.  The 
answer  to  this  lies  in  the  following  section  on  applications  where  it  is  shown 
that  the  above  error  model  can  be  realized  even  when  the  output  of  the  unknown 
gain  is  not  measurable. 

4.  Applications : All  the  adaptive  observer  and  control  problems  which  could  be 


resolved  using  the  error  model  for  the  third  prototype  in  the  continuous  case 
have  their  counterparts  in  the  discrete  case  as  well.  We  merely  describe  here 
briefly  two  important  applications  to  indicate  how  the  error  model  described  in 
the  previous  section  (3)  can  be  derived  and  used  in  the  generation  of  the  adaptive 
laws. 

a)  A Discrete  Adaptive  Observer: 

The  input  u(k)  and  the  output  y(k)  of  an  unknown  stable  linear  time-invariant 

plant  are  given.  If  the  z-transfer  function  of  the  plant  is  P(z)/Q(z)  where  P(z) 

th 

is  an  n degree  polynomial  in  z and  Q(z)  an  n degree  monic  stable  polynomial, 
the  plant  cah  be  described  by  (2n-H)  parameters  which  are  the  coefficients  of 
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P(z)  and  Q(z).  An  adaptive  observer  Is  to  be  constructed  which  will  estimate  these 
parameters  and  evolve  to  the  true  values  asymptotically. 

Following  [2]  it  is  known  that  any  transfer  function  with  n poles  and  n zeros 
has  an  equivalent  non-minlmal  canonical  representation  given  by 


P1(z) 

R(z) 


F1(z)/F2(z) 

Qx(z)  F^z) 

" KtzT  ' F2(z)  - 


(6) 


where  P1  and  are  nth  and  (n-l)1"*1  degree  polynomials,  R(z)  is  any  ntl1  degree  monic 
stable  polynomial,  F^z)  and  F2(z)  are  mth  degree  monic  polynomials  (m  < n)  with 
F^(z)/F2(z)  strictly  positive  real  and  such  that  R(z)  contains  F^(z)  as  a factor. 

(In  the  simplest  case  we  can  choose  F^  = F2  * 1) . 

The  representation  of  (6)  in  block  diagram  form  is  shown  in  Figure  (3). 


Figure  (3) 

The  identification  of  the  plant  transfer  function  (i.e.  the  polynomials  P(z)  and 
Q(z))  is  now  reduced  to  the  identification  of  the  polynomials  P^(z)  and  Q^(z). 
Figure  (4)  shows  the  discrete  version  of  an  adaptive  observer.  The  structure  of 
the  observer  la  identical  to  that  in  the  continuous  case  with  the  exception  of 

' 


i 
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T 

the  feedback  signal  (au  (k)Tu(k) Je^Ck) . The  parameters  a^k)  and  bj(k)  in 
the  model  are  estimates  of  the  corresponding  parameters  and  in  the 
plant  (i  ■ 1,2, ...,n;  j = 0,1,. ..n). 
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If  wT(k)  - [w1(k) ,w2(k) , . . .wn(k) ] ; vT(k)  = [vQ(k)  .v^k) , . . .v^Ck)  ] in  Figure  (4), 

T T T 

defining  u (k)  ■ [w  (k)  ,v  (k)]  the  error  equations  can  be  represented  in  the 
form  shown  in  Figure  (2)  and  hence  the  adaptive  laws  can  be  written  by  inspection 
as 


a(k+l) 

a(k) 

w(k) 

= 

-r  e (k) 

b(k+l) 

b(k) 

1 

v(k) 

It  is  worth  pointing  out  that  while  the  signals  corresponding  to  w(k)  and  v(k) 

T 

in  the  plant  are  not  accessible,  (and  hence  4>(k)  u(k)  in  Figure  (2)  is  not 

accessible)  the  desired  error  model  is  obtained  by  feeding  back  the  signal 
T 

(cm  (k)ru(k))e^(k)  in  the  model  as  shown  in  Figure  (4). 
b)  The  Adaptive  Control  Problem: 

We  consider  in  this  section  the  simplest  of  the  control  problems  treated 
in  [8]  where  an  unknown  linear  time-invariant  plant  with  a single  input  and 
single  output  is  to  be  controlled  to  follow  the  output  of  a specified  model  with 
a strictly  positive  real  transfer  function.  We  shall  treat  only  the  case  where 
a single  parameter  of  the  controller  can  be  adjusted  and  extend  the  results 
directly  to  the  general  case  where  (2n+l)  parameters  are  to  be  adjusted.  For 
the  latter  case  we  shall  merely  indicate  the  structure  of  the  adaptive  controller 
and  the  form  of  the  adaptive  laws. 

Let  an  unknown  plant  be  represented  by  the  difference  equation 

x (kfl)  = Ax  (k)  + bv(k) 

P P 

y (k)  = cTx  (k)  + dv(k) 

P P 

where  the  matrix  A,  vectors  b and  c and  scalars  d are  unknown.  If  v(k)  = r(k)  + 

+ 8(k)y  (k) , then  (3(k)  represents  the  gain  in  the  feedback  path 
P 

Figure  (5),  and  r(k)  the  input  to  the  overall  system. 
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A. 


as  shown  in 
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Our  aim  is  now  to  adjust  4>(k)  (or  equivalently  B(k))  such  that  e^k)  -*■  0 

as  k + ®,  To  reduce  the  error  model  (6)  to  the  standard  form  described  in  section 

2 

(3)  we  have  to  use  a feedback  with  a gain  oCTTpCk)  as  shown  in  Figure  (7)  or  in 
the  plant  as  shown  in  Figure  (8) . 


Figure  (7)  Modified  Error  Model 


r 


It  is  the  fact  that  the  error  e^(k)  can  be  fed  back  into  the  plant  that  allows 
the  new  error  model  to  be  realized.  The  adaptive  law  can  now  be  written  down 
by  inspection  as: 

Ag(k)  - A$(k)  - -Y  e- (k)y  (k)  Y > 0 . 

1 P 

For  the  general  case  of  an  unknown  plant  with  transfer  function 

Q(z) 

where  P(z)  is  an  n^  degree  stable  polynomial  and  Q(z)  is  a monic  nC^  degree 
polynomial  whose  output  is  to  follow  the  output  of  a given  model  with  strictly 
positive  real  transfer  function,  it  can  be  shown  that  a controller  of  the  form 
shown  in  Figure  (9)  can  be  used  to  achieve  the  above  objective. 

The  controller  consists  of  (2n+l)  adjustable  parameters  kgtC^.c^,... 

A A A A 

...,c  ,d  ,d  ,...,d  which  are  the  elements  of  a parameter  vector  3 and  two 
n i i n 

identical  auxiliary  signal  generators  with  stable  transfer  functions  whose  inputs 
are  the  plant  input  and  output  respectively.  If  reference  input  r(k)  together 
with  the  2n  signals  v^(k)  ^(k)  , . . *vn(k)  , w^Ck) , . . .wn(k)  is  defined  as  u(k)  : 

u(k)T  A [r(k),v  (k),v  (k),...v  (k) ,w  (k) , . . .w  (k)] 
l i n l n 

T 

and  a signal  [ctu(k)  Tu(k)]  is  fed  back  as  shown  in  Figure  (9),  the  total  input 
to  the  plant  may  be  expressed  as 

0T(k)u(k)  - [auT(k)Tu(k) Je^Ck) 

* 

If  a constant  6 exists  such  that  Model  and  Plant  transfer  functions  are  identical 
» * 

when  0 = 0,  then  we  obtain  an  error  model  of  the  form  shown  in  Figure  (2) . Once 
again  the  adaptive  laws  can  be  written  by  inspection  as 


0(k*l)  - 0(k)  - r e;L(k)u(k) 
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V 


Figure  (9) 

Conclusion:  A new  error  model  for  discrete  adaptive  systems  is  presented  in 
this  paper.  By  introducing  a feedback  term  in  the  corresponding  error  model  for 
the  continuous  case  it  is  found  possible  to  retain  the  same  form  for  the  adaptive 
laws.  It  is  demonstrated  that  the  output  error  tends  to  zero  whether  or  not  the 
input  vector  is  bounded. 

The  new  error  model  has  wide  applications  in  both  adaptive  identification 
and  adaptive  control.  Two  applications  are  outlined  towards  the  end  of  the  paper 
to  indicate  how  the  error  model  is  derived  and  the  corresponding  adaptive  laws 
generated. 
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